A process pattern model for tackling and improving big data quality

Data seldom create value by themselves. They need to be linked and combined from multiple sources, which can often come with variable data quality. The task of improving data quality is a recurring challenge. In this paper, we use a case study of a large telecom company to develop a generic process pattern model for improving data quality. The process pattern model is defined as a proven series of activities, aimed at improving the data quality given a certain context, a particular objective, and a specific set of initial conditions. Four different patterns are derived to deal with the variations in data quality of datasets. Instead of having to find the way to improve the quality of big data for each situation, the process model provides data users with generic patterns, which can be used as a reference model to improve big data quality

An insight into imbalanced Big Data classification: outcomes and challenges

Big Data applications are emerging during the last years, and researchers from many disciplines are aware of the high advantages related to the knowledge extraction from this type of problem. However, traditional learning approaches cannot be directly applied due to scalability issues. To overcome this issue, the MapReduce framework has arisen as a “de facto” solution. Basically, it carries out a “divide-and-conquer” distributed procedure in a fault-tolerant way to adapt for commodity hardware. Being still a recent discipline, few research has been conducted on imbalanced classification for Big Data. The reasons behind this are mainly the difficulties in adapting standard techniques to the MapReduce programming style. Additionally, inner problems of imbalanced data, namely lack of data and small disjuncts, are accentuated during the data partitioning to fit the MapReduce programming style. This paper is designed under three main pillars. First, to present the first outcomes for imbalanced classification in Big Data problems, introducing the current research state of this area. Second, to analyze the behavior of standard pre-processing techniques in this particular framework. Finally, taking into account the experimental results obtained throughout this work, we will carry out a discussion on the challenges and future directions for the topic.This work has been partially supported by the Spanish Ministry of Science and Technology under Projects TIN2014-57251-P and TIN2015-68454-R, the Andalusian Research Plan P11-TIC-7765, the Foundation BBVA Project 75/2016 BigDaPTOOLS, and the National Science Foundation (NSF) Grant IIS-1447795

Developmental Sex Differences in Nicotinic Currents of Prefrontal Layer VI Neurons in Mice and Rats

There is a large sex difference in the prevalence of attention deficit disorder; yet, relatively little is known about sex differences in the development of prefrontal attention circuitry. In male rats, nicotinic acetylcholine receptors excite corticothalamic neurons in layer VI, which are thought to play an important role in attention by gating the sensitivity of thalamic neurons to incoming stimuli. These nicotinic currents in male rats are significantly larger during the first postnatal month when prefrontal circuitry is maturing. The present study was undertaken to investigate whether there are sex differences in the nicotinic currents in prefrontal layer VI neurons during development.Using whole cell recording in prefrontal brain slice, we examined the inward currents elicited by nicotinic stimulation in male and female rats and two strains of mice. We found a prominent sex difference in the currents during the first postnatal month when males had significantly greater nicotinic currents in layer VI neurons compared to females. These differences were apparent with three agonists: acetylcholine, carbachol, and nicotine. Furthermore, the developmental sex difference in nicotinic currents occurred despite male and female rodents displaying a similar pattern and proportion of layer VI neurons possessing a key nicotinic receptor subunit.This is the first illustration at a cellular level that prefrontal attention circuitry is differently affected by nicotinic receptor stimulation in males and females during development. This transient sex difference may help to define the cellular and circuit mechanisms that underlie vulnerability to attention deficit disorder

Custom Hardware Versus Cloud Computing in Big Data

The computational and data handling challenges in big data are immense yet a market is steadily growing traditionally supported by technologies such as Hadoop for management and processing of huge and unstructured datasets. With this ever increasing deluge of data we now need the algorithms, tools and computing infrastructure to handle the extremely computationally intense data analytics, looking for patterns and information pertinent to creating a market edge for a range of applications. Cloud computing has provided opportunities for scalable high-performance solutions without the initial outlay of developing and creating the core infrastructure. One vendor in particular, Amazon Web Services, has been leading this field. However, other solutions exist to take on the computational load of big data analytics. This chapter provides an overview of the extent of applications in which big data analytics is used. Then an overview is given of some of the high-performance computing options that are available, ranging from multiple Central Processing Unit (CPU) setups, Graphical Processing Units (GPUs), Field Programmable Gate Arrays (FPGAs) and cloud solutions. The chapter concludes by looking at some of the state of the art solutions for deep learning platforms in which custom hardware such as FPGAs and Application Specific Integrated Circuits (ASICs) are used within a cloud platform for key computational bottlenecks

Visualizing Large Graphs Out of Unstructured Data for Competitive Intelligence Purposes

International audienceIn the information era, people’s lives are deeply impacted by IT via exposure to social media, emails, RSS feed, chats, web pages, etc. Such data is considered very valuable nowadays since it may help companies to better their strategies. For example, companies can analyse their customers’ trends or their competitors marketing interventions and adjust their strategies accordingly. Several decisional tools have been developed but most of them rely on relational databases. This makes it difficult for decision makers to take advantage of unstructured data which today represents more than 85% of the available data. Thus, there is a rising need for a suitable management process of unstructured data through collecting, managing, transferring and transforming it into a meaningful informed data. This paper will introduce a new tool for Big Unstructured Data for the Competitive Intelligence named Xplor EveryWhere (XEW). It will also describe the enhancement brought to its newest feature XEWGraph. This tool, or as described later on the paper, this “Service”, offers the decision makers the possibility to have a better user experience regarding large graph visualization on their web browsers as well as their mobile devices

Big Data, new epistemologies and paradigm shifts

This article examines how the availability of Big Data, coupled with new data analytics, challenges established epistemol- ogies across the sciences, social sciences and humanities, and assesses the extent to which they are engendering para- digm shifts across multiple disciplines. In particular, it critically explores new forms of empiricism that declare ‘the end of theory’, the creation of data-driven rather than knowledge-driven science, and the development of digital humanities and computational social sciences that propose radically different ways to make sense of culture, history, economy and society. It is argued that: (1) Big Data and new data analytics are disruptive innovations which are reconfiguring in many instances how research is conducted; and (2) there is an urgent need for wider critical reflection within the academy on the epistemological implications of the unfolding data revolution, a task that has barely begun to be tackled despite the rapid changes in research practices presently taking place. After critically reviewing emerging epistemological positions, it is contended that a potentially fruitful approach would be the development of a situated, reflexive and contextually nuanced epistemology